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INTRODUCTION  ■  ' 

This  research  is  one  of  a  series  of  projects  in  v^hich  the  Bureau  of  Agri- 
cultural Economics  is  cooperating  vdth  representatives  of  food  industries  in  an 
attempt  to  discover  consumer  preferences  and  acceptance  within  a  given  kind  of 
processed  foode    These  projects  have  been  approached  vdth  the  view  that  there  are 
three  steps  in  research  on  the  acceptance  of  food  products  2/,  3/ : 

1.    Discrimination  tests -,-Bef ore  consumers  can  be  asked  to  state  their 
preferences  mth  respect  to  several  variations  of  a  food  product,  it  must  be 
knom  tnat  they  can  readily  detect  the  differev^ces  represented  by  the  variations  0 
These  tests  are  best  conducted  on  a  rigidly  controlled  laboratory  basis  using 
subjects  who  are  not  "expert"  tasters o 

2^    Preference  tests g-These  tests  are  used  to  ascertain  the  relative  pref- 
erences for  the  variations  of  the  food  products  that  it  has  been  found  consumers 
can  distinguish  between*    To  be  of  value,  such  tests  should  be  conducted  on  the 
basis  of  cross-section  sampling  of  household  populations e 

3«    Ilarket^  testSo-The  item  most  preferred  is  placed  on  the  market  in 
selected  cities,  thus  providing  a  final  test  of  the  acceptance  of  the  product  in 
an  actual  selling  situation* 


1/'   The  research  on  which  this  repoirb  is  based  was  made  under  authority  of  the 
Agricultural  Marketing  Act  of  19U6  (RLIA,  Title  II),    The  Bureau  of  Agricultural 
Economics  assumed  major  responsibility  v.dth  the .  cooperation  of  the  IjemOA .  f)^oduct5 
Advisory  Board,    The  Lemon  Products  Advisory  Board  supplied  the  frozen  concen- 
trates for  lemonade 0  '  ;  •' 

2/    Clements,  Forrest  Eu    Psycho-physical  Ilethods  in  Market  Research*  Pro- 
ceedings Florida  State  Horto  Soc*,  Froco  6ki  Il4.8-153>  193'1'» 

3/    Bayton,  J*  A»    wlajor  Steps-  in  Food  Product  Acceptance  Research c    Paper  de- 
livered before  Virginia  Academy  of  Sciences,  iiay  16,  19$2-^    (Unpublished » ) 


In  addition  to  the  frozen  concentrates  for  lemonade  ivith  which  this  report 
is  concerned,  such  research  has  been  conducted  on  canned  orange  juice    hf  and 
frozen  concentrated  apple' juice  To  date,  however,  only  the  latter  prod- 

uct has  been  carried  through  the  three  steps  outlined  above. 

The  present  project  is  concerned  basically  iiritH  21  frozen  concentrates  for 
lemonade  that  vary  in  oRrix  (degree  of  sweetness)  and  in  Brix-acid  ratio,  which 
is  the  ratio  bet^veen  the  sweet-sour  qualities  of  the  product.    All  variables 
other  than  °Brix  and  Brix-acid  ratio  were  held  constant.    The  21  lemonades  are 
listed  in  tables  1  and  2  and  shown  graphically  in  figure  1,    Table  1  gives  the 
values  for  the  products  before  reconstitutionj  table  2  shows  the  values  after  the 
products  had  been  reconstituted  and  they  are  referred  to  as  "beverage  constants." 
The  numbers  of  the  lemonades  on  the  graph  correspond  to  those  in  the  tables. 

;        The  21  lemonades  extend  considerably  beyond  the  range  that  is  considered 
commercially  feasible  at  the  present  time.    This  range  is  represented  by  the 
broken  line  in  figure  1..   , 


Table  l»-Fro2en  concentrates  for  lemonade  used  in  discrimination  tests  (values 

given  are  actual  base  analysis  2/ 


Concentrate  No. 

°Brix 

Brix-acid  ratio 

1      ■  - 

32,22 

ll.li  . 

2         ..  . 

31.2U 

13.2 

3 

36.70 

'  ii.3 

k 

37. 3U 

13,5 

5  ... 

35.96 

■            15.5  .  -■■ 

-  ■  6 

11.33 

:  '  ii.U 

.  -,  7  . 

ii.0.00 

17.ii 

8 

U2o63 

• .'  ■  ■  13.U 

9 

h2ol0 

■     '15.5  ■  •'  ' 

■   10  ■  :           ■,.    .  .....  . 

,  it7.72 

13.6 

11 

J47.7O 

12    ■  , 

Ii7.09 

' :  17.7  ■ 

13 

52.82 

13.7 

lli 

53.89 

15.7' 

15 

.53.iiU 

17«8 

■  ■■■  16 

'  51.I1.I4 

■    •  -19.7      •  ■ 

17 

58.96 

..    15.8  • 

18 

59,79 

'•  17.9 

 •••-•-'19  ■  — 

58,20     ,.  , 

20.0  . 

■  ■  ■  .  20-     ■'■     .  " 

65»70 

...  ■■■-■■.^^ 

■                   ■■  ■■■■ 

65.26 

.  20.2 

1/    Pulp  content  of  bases  3.8  grams  per  6  ounces  (retained  on  20  mesh).    Oil  V 
content  of  beverages  (table  2)  0«00li.5  percent,  by  volume,  recoverable,  Clevenger. 


Baybon,  J,  A.   Ability  .to  Discriminate  and  Preferences  in  Regard  to  Canned  11 
Grange  Juices  that  Vary  in  Brix-acid  Ratio.    Bur..  Agr.  Econ.  27  pp.  Nov.  1950; 

Supplement;!,,  16  pp.    Jan.  1951.  (Processed) ,                                                    ■.  ^.  j 

5/    Bayton,  J.  A,    Preferences  for  Selected  Frozen  Concentrated  Apple  Juicei  "  '  ] 

Bur,  Agr.  Econ,  21  pp.  J^Jine  1951.  (Processed)  j 

6/    Baybon,  J,  A,,  Dwoskin,  P,  B,,  and  Robert,  S,  A,    llevr  Concentrated  Apple 
Juice  -  Its  Appeal  to  Consumers,    Bur,  Agr,  Econ,  US  pp.  illus.  Nov,  1951* (Brocessec 


Table  2«-Frozen  concentrates  for  lemonade  used  in  discrimination  tests  (values 

given  are  beverage  constants) 


Concentrate  No. 

°Brix 

Brix-acid  ratio 

1 

6»70 

11.2 

2 

6.1i9 

13.0 

3 

7.75 

10.9 

h 

7,90 

13.2 

$ 

7.58 

15.2 

6 

8.87 

11.1 

7 

8.55 

16.8 

8 

9.19 

13.1 

9 

9.06 

15.1 

10 

10.U7 

13.1 

11 

10.i|6 

IU.7 

12 

10.31 

16.9 

13 

11.80 

13.1 

lU 

12.08 

lii.9 

15 

11.96 

16.8 

16 

11.1^3 

18.7 

17 

I3.I46 

15.0 

18 

13.69 

17.1 

19 

13.25 

18.9 

20 

15.37 

17.1 

21 

15.23 

19.0 

-  k  ~ 


BEVERAGE  CONSTANTS  of  the  FROZEN 
CONCENTRATES  FOR  LEMONADE 

Used  for  Discrimination  Tesis  and  Preliminary  Preference  Ratings 


BRIX 


14 


12 


1  0 


8 


□  A 


•  6 


•  3 


®1 


17 


r  

•  13 


20 


18 


14 


•  10 


11 


•15 


•  4 


•  9 


□  b 


•  7 


® 


21 


•  19 


•  16 


•     Original  sek  of  21  concentrates 
®     Mutually  discriminable  concentrates  in  original  set 
<=>     Additional  concentrates 

Commercially  feasible  range 


8 


10 


12         14  16 
BRIX-ACID  RATIO 


18 


20 


22 


U.  S.  DEPARTMENT  OF  AGRICULTURE 


NEG.  48819  -VX     BUREAU  OF  AGRICULTURAL  ECONOMICS 


Figure  I 


PROCEDURE  FOR  DI3CRI1HIIATI0K  TESTS 

The  concentrates  for  lemonade  v:ere  kept  in  frozen  storage  at  ^  below  zero 
'°F,,  \mtil  they  v/ere  reconstituted  just  before  testing-,    In  attacking  tlie- problem 
I  of  discrimination;  it  wa,s.  decided  to  use  concentrate  Noo  1  (6^70  °Brix  and  llt2 
Brix-acid  ratio  1/)  as  an  "anchor  po^Ilt"  and  to  discover  --.vhere  discrimination  in 
terns' of  that-  concentrate  set  in*    This  nev;  point  Trould  then  be  used  and  the  next 
1  distinguishable'  point  from  rb  determined-,    This  procedure  vras  to  be  f  ollovred  un- 
.til  a  set  of  mutually  distinguishable  lemonades  had  been  obtained. 

As  in  this  approach  ability  to  distinguish  betxTeen  a  given  pair  of  lemon- 
I  ades  was  the  problem,  the  duo-trio  procedure  v;as  useda    To  illustrate  this 
procedure,  let  us  assume  that  v/e  have  tvra  lemonades  —  A  and  Bo    The  subject  is 
presented  xrith.  three  glasses,  the  first  of  which  is  the  control  lemonade o    He  is 
•  told  that  one  of  the,  other  tv/o  differs  from  it  and  that  the  other  one  is  e::actly, 
the  samec    The  subject  tastes  the  control^  then  tastes  the,  next  two  and  indicates 
the  one  he  thinlcs  differs  from  the  first  item  tastedo    To  offset  effects  of 
position,  all  possible  orders  of  presentation  were  randomly  assigned  to  the  sub- 
|jects»    These  orders  are:  -.  ^:  ._v' 

A  -  A  B 

•  A  -  B  A'     .    ^  ■■ ■■; ' 

   -  .         ■         B  -  A  B 

•  ••  ■      •  '  B  -  B  A 

t  The  design  of  the  experiment  called  for  18  subjects  to  make  two  judgments 

'  in  testing  a  given  pairing^  making  for  a  chivsquare  test  based  upon  36  judgments, 
I  If  12  of  these  judgments  vrere  incorrect,  the  data  would  not  be  a  statistically 
'  significant  indication  that  the  two  lemonades  in  a  pairing  could  be  distinguished 
by  this  group  of  subjects o    The  subjects  were  employees  of  the  Department  of- 
Agriculture  in  Washingtonr,    The  tests  were  *  administered  in  a  laboratory  set  up  in 
1  the  Department's  South  Building*    The  subjects  were  asked  not  to  eat  for  one-half 
hour  and  not  to  smoke  for  1^  minutes  before  comjjig  to  the  laboratory* 

.  "  .0 

The  concentrates  vrere  reconstituted  with  v/ater  at  approximately  35 
The  reconstituted  lemonades  were  kept  under  refrigeration  between  tests*  The 
i  lemonades  were  presented  to  the  subjects  in  glasses;  no  ice  was  usedo    The  tem- 
I  perature  of  the  lemonades  ^t  the  time  of  testing  varied  between        and  Fo 
Each  test  was  administered  to  tv/o^  subjects  ^t  .a  time* 

The  reconstituted  lemonades  were  stirred  continually  between  tests  bu-fi  ivhen  a« 
pitcher  became  about  three-fourths  empty^  the  remainder  was  discarded  and  a 
fresh  pitcher  of  that  lemonade  was  prepared  i    This  was  done  to  insure  that  the 
consistency  of  a  reconstituted  lemonade  remained  the  same  from  one  test  to 
another.       v.    V...   

Each  subject  took  a  sip  of  v/ater  between  the  two  test  series* 


jj  Throughout  the  remainder  of  this  report  these  values  refer  to  beverage 
constants  a 


RESULTS  OF  THE  DISCRIMBIATION  TESTS 


Results  of  the  discrimination  tests  are  given  in  table  3«    Each  pair  of 
lemonades  is  identified  by  number  (table  2  and  fig#  1),  by  ^Brix  and  by  Brix- 
acid  ratio.    With  lemonade  Noo  1  (6.70  °Brix  and  11«2  Brix-acid  ratio)  ability 
to  detect  a  difference  occurred  vihen  it  was  paired  iidth  lemonade  No,  8  (9119 
°Brix  and  13el  Brix-acid  ratio).    Vfith  lemonade  No*  8  as  the  control,  the  next 
discriminable  point  was  lemonade  Ko«  Ik  (12^08  ^Brix  and  lli.9  Brix-acid  ratio). 
This  latter  lemonade  became  the  new  control  and  lemonade  No.  21  (1^.23  °Brix 
and  19.0  Brix-acid  ratio)  could  be  distinguished  from  it.    The  four  lemonades 
that  Tvere  mutually  discriminable  were  Nos.  1,  8,  lU,  and  21.    (These  four  points 
are  encircled  in  fig.  1.) 

Reference  to  figure  1  shows  that  only  one  of  these  four  lemonades  is 
within  what  is  considered  to  be  the  commercially  feasible  range*    Our  results 
are  such  as  to  lead  to  the  conclusion  that  most  "non-expert"  tasters  cannot 
easily  detect  the  difference  between  two  lemonades  such  as  No.  10  (lO^U?  *^Brix 
and  13.1  Brix-acid  ratio)  and  No.  15  (11.96  °3rix  and  16 o 8  Brix-acid  ratio) » 


Table  3 .-Results  of  discrimination  tests  of  21  frozen  concentrates  for  lemonade 

(in  the  order  in  which  the  tests  were  made) 


Control 

lemonade 

1  ■ '" "\  

j        Test  lemonade           j   No*  of 

'   

No,  of 

i  Total 

Brix-acid 

1 

1 Brix-acid 

correct 

incorrect 

;       No.  of 

NOe 

Brix 

ratio 

No. 

"^Brix 

!    ratio     1  judgments 

judgments 

judgments 

1 

6,70 

11.2 

3 

7.75 

r —  1  

10.9      '  8 

12 

r 

20 

1 

6o70 

11,2 

1  6 

8.87 

11.1 

22 

Ih 

36 

1 

6.70 

11.2 

2 

6.U9 

13.0 

h 

12 

16 

1 

6.70 

11.2 

h 

7.90 

13*2 

2h  . 

12 

1 

6.70 

11.2 

8 

9.19 

13.1 

25 

11 

1/36 

8 

9ol9 

13.1 

5 

7,58 

15.2 

19 

13 

32 

8 

9al9 

13*1 

13 

11,80 

13»1 

15 

13 

28 

8 

9.19 

13.1 

9.06 

15.1 

8 

12 

20 

8 

9.19 

13.1 

7  ! 

8,55 

16.3 

11 

13 

1/36 

8 

9.19 

13.1 

Ih  : 

12»08 

IU.9 

25 

11 

8 

9.19 

13.1 

12  : 

10,31 

16.9 

12 

12 

2h 

11; 

12.08 

lh.9 

17 

13  01+6 

15.0 

12 

12 

2h 

Ih 

12,08 

lh.9 

1 

11.96 

16.8 

16 

12 

28 

Ih 

12,08 

1U,9 

16  1 

ll.li3 

18.7 

9 

13 

22 

Ih 

12,08 

IU.9 

18  1 

13.69 

17.1 

11 

13 

2h  - 

Ih 

12.08 

lii.9 

20  i 

15c  37 

17.1 

2h 

12 

•  36 

Ih 

12,08 

lii.9 

19  ! 

13»25 

18.9 

10 

111 

1/36 

Ih 

12,08 

1U.9 

'    21  i 
1 

15.23 

19.0 

26 

10  ' 

1/  The  number  of  correct  judgments  is  significantly  greater  than  would  be  ex- 
pected on  the  basis  of  chance o 


Although  it  is  current  commercial  practice  to  produce  frozen  concentrates 
for  lemonade  within  the  region  indicated  in  figure  1,  the  question  arises  as  to 
the  significance  in  terras  of  consumer  preferences,  of  changing  the  product  in 
given  directions.    It  is  possible  that  a  change  in  °Brix  and  Brix-acid  ratio  in 


-  7  - 


one  direction  will  lead  toward  consumer  negativism  but  that  a  change  in  another 
direction  will  lead  toward  quite  favorable  reactions  on  the  part  of  consumers. 


Because  lemonades  1  and  21  were  so  far  beyond  the  commercially  feasible 
I  range,  a  new  set  of  concentrates  was  prepared^    These  concentrates  -were  just  out- 
side the  rsuige?    The  nev:  set  is  designated       B,  C^,  and  D  in  figure  lo  •  The 
approach  nov:  became,  are  these  four  concentrates  mutually  distinguishable  from 
each  other?    It  was  assumed  that  they  vrere  not  all  distinguishable  from  any  given 
concentrate  ivithin  the  range o    If,  however,  these  four  should  satisfy  the  dis- 
crimination test,  consumer  preference  research  with  the  four  would  permit 
anticipation  of  consumer  reactions  should  a  change  in  any  of  these  four  directiohs 
be  contemplated.    The  point  from  which  such  changes  might  be  made  is  considered 
theoretically  as  being  in  the  center  of  the  commercially  feasible  range* 

The  four  new  concentrates  were: 


Ao 
B, 

Cc 


10    Brix  and  11«1  Brix-acid  ratio 
10  °Brix  and  l6o6  Brix-acid  ratio 
12c.6  ^Brix  and  lIicO  Brix~acid  ratio 
12 o6  °Brix  and  21=0  Brix-aoid. ratio 


Results  of  these  discrimination  tests  are  given  in  table  h»  Lemonades 
B,  C,  and  D  were  mutually  disorlminablec    Lemonade  A  could  be  distir^uished  from 
lemonade  D  but  not  from  B  or  C«    In  other  ivords,  the  "distance"  bet\veen  A  and  B 
and  between  A  and  C  needs  to  be  increased  if  non-expert  tasters  are  to  be  ex- 
pected to  detect  differences ^ 

If  further  research  is  decided  upon,  it  has  been  recommended  that  concen- 
trates C  and  D  be  retainedr    Concentrate  A  would  be  replaced  with  a  concentrate 
having  9  °Brix  and  llo2  Brix-acid  ratioi    Concentrate  B  would  be  replaced  with  a 
concentrate  having  9  °Brix  and  18  Brix-acid  rabiot 


Table  l^c-Results  of  discrimination  tests  of  frozen  concentrates  for  lemonade 

A,  B,  C,  and  D 


1/  The  number  of  correct  judgments  is  significantly  greater  than,  would  be  ex-' 
pected  on  the  basis  of  chance e 


6  ^  , 

ERELII^INARY  PREFERENCE  RATINGS,  OF  FROZEN  CONCENTRATES  FOR  LEICNADE  r  •  • 

The  results  presented  below  are  preliminary  for  two  reasons  #    First,  our 
major  concern  v;as  to  develop  an  efficient  method  for  obtaining  preference  ratings. 
In  working  with  three  items,  the  Method  of  Paired  Comparisons  is  an  efficient 
procedure  •   lilfhen.,  as  in  the  present  situation,  four  items  are  involved,  the 
Method  of  Paired  Comparisons  is  inadequate ,    Each  individua^l  would  have  to  taste 
six  pairs  of  lemonades  9-   In  any  taste  experiment,  because  of  the  rapid  rate  of 
a,daptation  of.  the  sensory  system,  this  is  too  many.    Second,  the  results  are  . 
limited  because  of  the  small  numbers  of  subjects  used  in  the  various  preference 

;jteStS-9    ,-  .■  ,   :  ■ 

Concentrates  used  were  1,  8,  lli,  and  21, 

PROCEDURES  FOR  THE  PREFERENCE  TESTS 

Rank  order  method »-After  reconstituting  the  four  concentrates  for  lemon- 
ade, the  four  glasses  were  placed  in  a  rovr  on  a  table  before  the  subject •  The 
original  position  of  the  four  concentrates  varied  randomly  from  subject  to  sub- 
ject.  For  purposes  of  the  description  that  follows,  the  four  positions  are 
designated  (1)  -  (2)  -  (3)  •  (U). 

The  subject  tasted  the  lemonade  on  the  ektrekie  left  (1)  and  placed  dt  ia 
front  of  the  other  three: 

(2)  -  (3)  -  ih)  ■    ■  ' 
(1) 

•  '      He  then  tasted  the  one  second' from  the  left  (2)  and  placed  it  in  relation 
to  (1)  in  terms  of  "I  like  this  one  (2)  better  than  that  (1),"  or  "That  one  (l) 
is  better  than  this  (2)»"    This  yielded  either  ' 

(3)  -  ih)  oj.  (3)  -  ih) 

(1)  -  (2)  (2)  -  (1) 

Next,  the  subject  tasted  (3)  and  placed  it  in  relation  to  the  lemonade  at 
the'  right  in  the  new  series' being  developed.  If  the  prior  step  led  to  (1)  -  (2)^ 
and  (3)  was  better  than  (2),  the  positions  became  (l)  -  (2)  -  (3)«  If  the  prior 
step  -gave  (l)  -  (2)  and  (3)  was  judged  not  as  good  as  (2),  the  subject  was  asked 
to  judge  (3)  "in  relation  to  (1).    From  this  emerged  either  - ; 

(3)  -  (1)  -  (2)     .      or  (1)  -  (3)  -  (2)  : 

If  the  prior  step  gave  (2)  -  (1),  the  above  procedure  was  follovred,  giving  either 
(2)  -  (1)  -  (3),  (2)  -  (3)  -  (1),  or  (3)  -  (2)  .  (1), 

The  subject  next  tasted  the  last  lemonade  in  position  (U)  and  began  ty 
judging  it  in  relation  to  the  lemonade  then  occupying  the  position  at  the  e^xtreme 
right  in  the  new  series.    If  ih)  was  less  preferred  than  the  lemonade  in  the:.  I 
extreme  right  position,  it  was  judged  in  relation  to  the  other  lemonades,,  going  . 
to  the  left  until  it  was  finally  placed. 

VJhen  the  new  order  had  been  established  the  subject  was  asked  to  taste 
the  lemonades  again  to  verify  his  order  of  preference  0.    He  was  permitted  to 
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i  change  the  orde?":,  if  he  mshed«    The  scoring  was  1  to  h,  starting  with  the  most 
i preferred  lemonade,  the  one  then,  occupying  the  extreme  right  position. 

In  order  to  investigate  the  reliability  of  this  method,  each  subject  re- 
ipeated  the  procedvire  after  an.  interval... of  3  or-U  daysj  2k  subjects  participated. 

Rating-scale  methode-This  procedure  attempted  to  combine  features  of  the 
£  Method  of  Constant'  Stimulus  and  a  rating-scale  method <,    Lemonade  Moo  8  was 
designated  as  the  constant  stimulus  and  each  of  the  other  three  lemonades  was 
judged  in  relation  to,.  it«    After  the  general  statement  of  preference  had  been 
imade,  the  intensity  of  preference  was  ascertained  by  use  of  the  rating  scale 
shoTjn  in  figure  2© 

I  The  subject  was  presented  with  two  lemonades  and  told  that  the  first  one 

the  TJ-ould  taste  had  an  arbitrary  value  of  kOn    VJhen  he  tasted  the  second  lemonade 
he  first  judged  it  in  terras  of  either  "better  than"  or  "worse  than"  the  firsts 
Mext>  using  the  rating  scale,  he  assigned  a  score,  or  rating,  to  ita  Lemonade 
No>,  8,  the  constant  stimulus,  was  presented  first  in  half  of  the  pairings  and 
last  in  the  other  halfc    The  sets  of  pairings  were  presented  randomly  to  the 
; subject So 

'  Scoring  vras  based  upon  the  difference  in  rating  assigned  the  actual  comr- 

parison' lemonade,  vjhether  it  occurred  first  or  second  in  a  given  pairing*  For 
example,  if  the  pair  judged  consisted  of  NoS'>  8  and  21,  in  that  order  of  pre- 
sentation to  the  subject,  and  llo,  21  v;as  "better  than"  and  was  given  a  rating  of 

'70,  its  score  became  30  j    If  No  e  21  vias  judged  "?/orse  than"  and  given  a  rating 
of  30,  its  score  became  -lOo    Yihen  the  constant  No,  6  was  second  in  a  pairing, 
the  score  remained  the  difference  in  rating  based  upon  a  score  of  iiO  for  No  a  8, 
In  this  instance,  if  the  order  of  presentation  v/as  Noo  21  and  Noo  8,  the  subject 
used  the  arbitrary  score  of  UO  with  NOo  21 «    If  he  said  that  Noc  8  was  "better 
than"  and  gave  it  a  rating  of  60,  the  score  fo]?  Noo  21  became  -20,    If  Noa  8  was 
judged  "vrarse  than"  and  given  a  rating  of  1$,  the  score  for  No*  21  was  2^, 

Twenty-four  subjects  evaluated  these  lemonades  by  both  methods  —  ranking 
and  rating  scale  o    Twelve  did  the  ranking  fir.?t  and  from  3  to  L.  days  later  they 
did  the  rating-scale  methodc    The  other  12  reversed  this  particular  procedure  a 


RESULTS  OF  THE  PRELIMINARY  PREFERENCE  TESTS 

Results  of  the  test-retest  preference  rankings  are  shown  in  table  5o  The 
rank  orders  were  the  same  on  both  tests  and  the  mean  rankings  were  quite  similar* 
Lemonade  Noc  Ik  (I2o08  °Brix  and  lkr.9  Brix-acid  ratio)  \vas  most  preferred o 
Second  in  preference  was  lemonade  Noc  21  (15^23  °Brix  and  19-^0  Brix-acid  ratio). 
The  least  preferred  lemonades  \irere  the  two  characterized  by  relatively  low  °Brix 
and  relatively  low  Brix-acid  ratio,  with  lemonade  Noo  1  (6© 70  °Brix  and  11 o2 
Brix-acid  ratio)  ranking  lowesto 

The  degre.e  to  y/hich  the  individual  subjects  were  consistent  in  the  initial 
test  and  in  the  retest  is  shown  in  table  6o    These  data  show  that  19  of  the  2k 
subjects  gave  a  given  lemonade  a  rank  of  k  on  the  two  tests,  l6  gave  a  given 
lemonade  a  rank  of  3  on  both  tests,  etCo    However,  three  subjects  vrho  gave  a 
lemonacle  (not' necessarily  the  same  one  for  each  of  the  three)  a  rank  of  I|.  on  the 
first  test  gave'  it  a  rank  of  1  on  the  retest«    Of  a  total  of  96  judgments  made  by 
the  2k  subjects,  72  percent  were  identical  in  the  two  tests o 
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Table  5 •-Test-retest  preference  rankings  of  four  concentrates  for  lemonade- 

(Number  of  subjects  »  2k) 


Concentrate  Number. 

Mean  rank 
first  test  " 

! 
» 

1 

Ifean  rank 
re-test 

lii 

1.71 

1 

1.71 

21      •         '  ■ 

:  ■    ••- '  2,00  . 

.  2,03 

'    8  ■ 

■  2.7^ 

t 

i 

■.   2.66         ■  ■ 

1  ■  .: 

•  3.$h 

1 

-  ■  3.58;       ;  ^ 

Table  6»-'Individual  consistency  in _  test-retest  rankings 
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;  ;   Figure  3  presents 'graphically  the  pireferences  for  the  four  lemonades  based 
upon  the  rating-scale  method.    The  value,  or  scores  assigned  to  each  lemonade  was? 
based  upon  the  mean  difference  in  relation  to  lemonade  No,  8*    For  example,  "the" '  • 
mean  difference  for  lemonade  No,  21,  in  relation  to  lemonade  N09  8,  was  8,  "as 
No,-  0  T/as  always  considered  as  having' a  valud  of        the  value  for  No,  21  is- 1^8 .  ■ 
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RATING  SCALE  USED 
FOR  PREFERENCE 

For  Four  Frozen  Concenirafes  for  Lemor^ade 
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PREFERENCE  SCALE  RESULTS 

For  Four  Frozen  Concenfrafes  for  Lemor)ade 
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Figure  3 


ITith  this  method,  in  comparison  to  the  rank  order  procedure,  the  position  was 
reverised  vdth  respect  to  the-  most  preferred  lemonade  •    In  the  ranlc  order  method, 
lemonade  Mo,  Ih  was  first  and  Noo  21  was  seconds    In  the  rating-scale  me"thod, 
lemonade  Wo.  21  was  first j  Noa  ll|.  xias  secondo    The  results  based  upon  the  rank- 
ing method,  when  used  by  these  particular  subjects,  -were  similar  to  those 
obtained  from  those  subjects  who  previously  had  used  only  this  method  (tables  $, 
7). 

.   Altogether  four  independent  evaluations  were  made  of  the  four  lemonades  — 
three  by  the  ranking  method  and  one  by  the  rating-scale  methods    For  any  one  of 
these  evaluations,  the  difference  between  No,  li;  and  Wo*  21  was  not  significant. 
Cn  the  other  hand,  in  the  series  of  three  evaluations  based  upon  the  ranking 
method,  Wo»  Ih  always  was  first  and  Noo  21  was  second©    This  particular  finding 
lends  support  to  the  viev/  that  No  a  ll|.  is  preferred  to  No-  21  o 

As  noted,  the  2h  subjects  who  used  the  rating-scale  method  also  ranked 
the  four  lemonades c    Individual  performances  on  the  two  methods  are  given  in 
table  8,    Inspection  of  table  8  shows  a  rather  high  degree  of  inconsistency  from 
one  method  to  the  other*    In  fact,  of  the  total  of  96  judgments  involved,  only 
k6  percent  v/ere  identical  in  the  two  methods o 


Table  7 o-Pref erence  rankings  of  the  four  concentrates  for  lemonade  by  the  2k  sub- 
jects who  also  made  rating-scale  preferences 


Concentrate  No* 

I'lean  rank 
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Table  8  ••Iridividnal  consistency      the  preference  ranking- and  prefejrence  scale 
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DISCUSSION 

The  outstanding  result  of  the  discrimination  tests  is  the  evidence  shov^- 
ing  that  most  "non-expert"  tasters  would  find  it  hard  to  detect  differences 
among  frozen  concentrates  for  lemonade  that  fall  within  the  commercially  feasible 
range*    "Experts,"  or  those  who  have  occasion  to  make  frequent  tests  of  concen- 
trates for  lemonade,  claim  that  they  can  detect  much  smaller  differences  than 
those  reported  here.    Two  considerations  must  be  borne  in  mind,  however*  First, 
the  subjects  of  the  present  experiment  were  not  experts  and  second,  the  tests 
were  conaucted  under  experimental  laboratory  conditions*    One  additional  point 
should  be  made.    The  discrimination  test  used  in  these  experiments  requires  that 
approximately  70  percent  of  the  judgments  must  be  correct  if  there  is  to  be  a 
statistically  reliable  indication  that  people  can  detect  a  difference. 

The  correct  way  to  approach  the  problem  of  discrimination  functions  is  in 
terms  of  the  proportionate  increases  that  are  required  to  insure  that  the 
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(differences  will  be  detected*    In  other  words,  what  we  need  to  know  is  the  ratio 
of  the  difference  that  gives  discrimination  to  the  original  value.    This  is  ex- 
pressed in- the  equation:  b  a 

'Ti/here  a  =  the  value  of  the  original  stimulus ^  b  =  the  value  where  discrimination 
i(  occurs  and  pi  «»  amount  of  proportionate  increase  o 


The  first  "anchor  point"  in  our  discrimination  tests  was  lemonade  No»  1 
(6.70  °Brix  and  11,2  Brix-acid  ratio).    Discrimination  occurred  at  lemonade  Wo, 
(9el9  °Brix  and  13.1  Brix-acid  ratio)*    The  difference  in  °Brix  is  2,k9  and 

=  0.372 


'The  difference  in  Brix-acid  ratio  is  l„9y  so 

These  data  sho¥f  that  m.th  a  lemonade  of  6  ©70  ^Brix  and  lltv2  Brix-acid 
ratio  increases  of  37 • 2  percent  in  ^Brix  and  17  percent  in  Brix-acid  ratio  yield 
a  discriminable  lemonade* 

,  Discrimination  xvas  obtained  between  lemonade  Noe  8  (9<,19  '^Brix  and  13 »1 
! Brix-acid  ratio)  and  lemonade  No.  1)4  (I2c08  ^Brix  and  lk^9  Brix-acid' ratio)* 
:The  increases  here  are  31.>ii  percent  in  '^Brix  and  13o7  percent  in  Brix-acid  ratio. 
Lemonade  Ho,  21  (1^.23  °Brix  and  19*0  Brix-acid  ratio)  could  be  distinguished 
from  l)Jo.  Ill  (12«06  *^Brix  and  1J|.9  Brix-acid  ratio)  o    In  this  case  there  is  a 
26,1  percent  increase  in  °Brix  and  a  27 »5  percent  increase  in  Brix-acid  ratio » 

Although  this  series  of  frozen  concentrates  for  lemonade  is  not  extended 
(enough  to  permit  a  conclusive  statement,  these  results  lead  to  the  tentative  view 
that  at  relatively  law  ^Brix  a  larger  proportionate  increment  is  necessary  to 
bring  about  discrimination  than  is  true  at  relatively  high  ^Brix«    Although  the 
I  series  in  terms  of  '-'Brix  does  not  proceed  by  fine'  enough  gradations  to  permit 
the  derivation  of  very  accurate  increment  factors,  it  seems  a  reasonable  assump- 
tion that  beloTf  10  °Brix  a  factor  of  0.1|0,  between  10  and  12  °Brix  a' factor  of 
'0.35>  and  above  12  °Brix  a  factor  of  Oojo  should  be  safe* 

Contrary  to'  the  case  of  °Brix  where  the  proportionate  incremental  increases 
become  smaller  as  ^Brix  rise,  the  higher  Brix-acid  ratios  appear  to  require  larger 
proportionate  incremental  increases  and  these  incremental  increases  become  smaller 
betiveen  th'd  lower  .ratios*   ■  •  ' 

Thus,'  the  distance  between  a  Brix-acid  rati6  of  lUo9  and  19  is  iiol  points, 
or  aji  increase  of  27  percent  of  the  ,ll4.o9  ratio*    However,  at  the  loiver  end  the 
difference  betwee^'  the  ratios  of  11*2  and  13.1  is  ■«19  points,  or  only  17  percent 
of  the  lle2  ratio..  Between  llj..9  and' 13.1,  the  difference  is  ll|  percent  of  the 
13.1  ratio.    As  in  the  cas^e'of  ^^Brix:,  the  Brix-acid  ratios  in  the  series  are  too 
far  apart  for  accurate  calculation  of  the  increment  factors*    However,  for  ratios 
below  15  a  factor  of  0*20  should  be  fairly  safe,  as.should  be  a  factor  of  0*30 
for  ratios  above  1^©       -  " 
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In  setting  up  the  tentative  ratio  values,  rather  libisral  "rounding"  was 
done.    This  is  justified  in  that  the  basic  concern  in  these  experiments  is  to 
locate  products  which  most  "non-experts"  can  readily  detect  as  different. 

Figure  h  shows  the  four  discriminable  lemonades  plotted  with    Brix  along 
one  axis  and  Brix- acid  ratio  along  the  other.    The  points  at  which  the  four 
lemonades  fell  are  encircled  and  connected  with  a  broken  linoc    It  was  of  some 
interest  to  derive  a  curve  of  best  fit  from  the  distribution  of  these  four 
lemonades  on  the  grid.    This  turned  out  to  be  an  exponential  curve  of  the  tjrpe 
R  =»  AB^  where  R  is  the  Brix- acid  ratio  and  x  is  °BriXe    The  equation  of  the  curve 
is 

log  y  =  a   +  bx 

where  y  is  the  Brix-acid  ratio  and  x  is  °Brix,    Using  the  values  of  the  four 
lemonades  found  to  be  discriminable,  the  equation  for  the  curve  of  best  fit  is 

log  y  =  *87653    +  .0257i^8x 

In  figure  k  this  calculated  curve  is  represented  by  the  solid  line  that 
has  been  projected  beyond  both  the  lower  and  upper  limits  of  the  four  juices 
used  in  its  calculation o 

Keeping  in  mind  the  cautions  regarding  increment  ratios  previously  dis- 
cussed, this  curve  and  the  incremental  factors  mentioned  above  can  be  used 
tentatively  to  set  up  hypothetically  discriminable  lemonades  anywhere  along  the 
range « 

Suppose  we  begin  with  a  lemonade  of  9  ^Brix  and  work  up  the  scale.  Ref- 
erence to  the  theoretical  curve  shows  that  a  lemonade  of  9  °Brix  should  have  a 
Brix-acid  ratio  of  about  12  089    As  we  are  using  a  factor  of  OaUO  for  "^Brix  below 
10,  we  can  calculate  that  an  increase  of  Uo  percent,  or  3«6  degrees,  will  be 
necessary  for  discrimination,  making  the  next  higher  lemonade  one  of  12.6  °Brix. 
In  the  same  way,  a  factor  of  0.20  for  Brix-acid  ratios  belov/  1$^  applied  to  the 
ratio  12r,8,  gives  an  increase  of  2-.$6j  or  a  lemoaade  with  a  Brix-acid  ratio  of- 
15  5  36.    Reference  to  tne  curve  shoWvS  that  a  ier.nnside  of  12  c  8  ^Erjjx:  should  have 
a  Brix-acid  ratio  of  about  i$r,9  and  considering  the  rather  liberal  rraj  in  which 
the  incremental  factors  were  rounded,  this  is  good  correspondence. 

We  would  therefore  expect,  subject  to  actual  test,  that  the  next  lemonade 
to  be  discriminated  from  one  with  9  *^Brix  -  12,  8  BrJjc-acid  ratio  would  be  a  12,6 
^Brix  -  15 1 5  Brix.-" acid  rat:lo  lemonade  -  For  the  next  above  this,  we  would  employ 
a  factor  of  0„30  for  the  incj-ease  in  Brixa  This  would  be  an  increase  of  3'»78  to 
give  a  lemonade  of  16^38  ^Brixe  According  to  the  curve,  such  a  lemonade  would 
need  to  have  a  Brix~aoid  ratio  of  about  19««99  By  actual  calculation,  with  the 
0.30  factor  for  lemonades  with  a  ratio  above  1^,  it  would  be  20.1. 

Thus,  theoretically  the  follovdng  three  lemonades  would  be  mutually  dis- 
criminable. 

Brix  Brix-acid  ratio  >  ■■ 

90  12.8 
12.6^  15.^ 
16, U°  20.0 
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DISCRIMINATION  CURVES 

For  Frozen  Concenf rates  for  Lemonade 
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This  same  procedure  can  be  employed,  starting  at  any  point  on  the  curve 
and  using  the  proper  incremental  factors-,    Although  these  increncntal  ratios  are 
admittedly  rough  and  their  values  tentative,  the  concept  is  nevertheless  sounds 
If  a  series  of  frozen  concentrates  for  leiiionade  v/ith  more  finely  divided  grada- 
tions C^Drix  18,  10f2^f  I8o5'0,  18,7^^  etce)  was  available more  reliable  incre- 
inent~ratios  could  be  r/orked  outo    As  it  no-nr  stands,  by  working  mth  the  set  of 
lemonades  used  in  this  study it  is  not  knoim  just  where  discrimina'tion  occurs 
in  the  area  betiTeen  lemonade  Noo  lli  and  lemonade  No,  21^  for  example.    All  that 
is  known  is  that  these  two  concentrates  can  be  distinguished s 

ITork  vfith  a  series  of  lemonades  vrhich  are  closer  together  bcth  m  "^Brix 
and  Brix-acid  ratios  would  doubtless  refine  the  accuracy  of  the  roughly  rounded 
incremental  factors  used  here  and  would  probably  change  somewhat  the  shape  of  the 
discrimination  curve  (though  not  its  t;;;'pe)« 

The  preference  tests  showed  that  the  ranking  method  is  more  reliable  than 
the  rating-scale  procedures    The  latter  seemed  to  require  too  imich  effort  on  the 
part  of  the  subjects o    Apparently,  it  would  be  difficult  to  administer  to  a 
sample  of  households  in  a  city,  especially  as  the  very  young  and  the  semi-literate 
respondents  would  have  trouble  with  the  scoring  systemo 

The  two  procedures  were  in  agreement  in  rating  lemonade  No-.  8  (9p19  °Brix 
and  13cl  Brix-acid  ratio)  as  third  and  lemonade  Ho»  1  (6c70  °Brix  and  ll<32  Brix- 
.  acid  ratio)  as  f qurth  in  preference.    These  results  are  a  strong  hint  that  as 
;  processors  of  fr.o?en  concentrate  for  lemonade  contemplate  changes  in  the  direc- 
■  tion  of  lower  °Brix.  and  a  lovrer  Brix-'acid  ratio  than  those  now  used  as  the  limits 
ivof  the  commercially  feasible  range,  they  risk  increased  consumer  negativism  to- 
;ward  the  product o    Not  only  did  lemonades  Noso  8  and  1  have  the  lowest  preference 
ratings,  but  the  degree  of  unanimity  of  opinion  about  the  matter  was  rather  high> 
This  was  demonstrated  in  the  three  sets  of  data  based  upon  the  rank  order  method. 
<  Of  the  72  rank  order  judgments  .given  on  the  three  different*  occasions,  lemonade 
INo.  1  \Tas  assigned  to  the  fourth,  or  least  preferred  position,  7 8. percent  of  the 
1  time.    Lemonade  Mo.  8  xms  given  the  third  position  in  62  percent  , of  the  judgments. 
! Higher  degrees  of  variability  were  associated  with  the  rankings  of  lemonades  Wos. 
.Ik  and  2I5    Lemonade  Wo.  Ih,  the  first  in  preference,  was  assigned  the  first 
j  position'  in  hO  percent  of  the  judgm.ents.    Lemonade  IIo«  21;,  second  in  preference, 
\was  given  the  second  position  in  only  27  percent  of  the  judgments s 

Similar  results  —  a  higher  degree  of  homogeneity  of  opinion  .being  as- 
; sociated  vn.th  the  less  preferred  concentrates  —  were  obtained  when  the  standard 
deviations  of  the  rating* scale  scores  r:ere  investi-gated^    For  lemonade  IIo.  1 
a-   =  10o77,  for  Iloo  Ih  c  =12,95,  and  for  No,  21  o"  -l6c9li-,    (As  lemo'nade  No^  8 
was  the  constant  stimulus  no  standard  deviation  could  be  determined  for  it  in  , 
this  procedure c  ^ 

The  suggested  directions  of  preference  found  in  this  preliminary  research 
would  appear  to  warrant  more  systematic  and  intensive  investigation  because  of 
♦their  implications  for  processors  of  frozen  concentrates  for  lemonade o  The 
t  following -approach  is  recommended 


-  1-^;  - 

Assume  that  the  most  preferred  frozen  concentrate  •.  for  lemonade  is  x-dthin 
the  commercially  feasible  range  as  currently  def ined#    Select  the  four  concen- 
trates for  lemonade  recommended  on  the  basis  of  the  present  discrimination  tests 
(p-  7):  ^ 

A«     9*0    Brix;  11,2  Brix-acid  ratio 

B»     9oO  OBrixj  18«0  Brix-acid  ratio 

C,  12 „6  ^Brixj  lk*0  Brix-acid  ratio 

D,  12 c6  *^Brix5  21,0  Brix-acid  ratio 

Conduct  preference  research  on  these  four  frozen  concentrates  for  lemonade*  The 
results  TTOuld  permit  processors  to  anticipate  consumer  reactions  to  changes  in 
the  product  in  any  given  direction,  if  the  change  were  great  enough  to  be  detect- 
ed. 

For  greatest  value,  this  preference  research  should  be  carried  on  in  dif- 
ferent regions  of  the  country  on  a  household  san^ling  basis,  as  it  is  possible 
that  preferences  for  these  products  vary  from  one  region  to  another » 

oS-xe      There  is  a  point  that  adds  a  complication  for  research  of  the  kind  re- 
ported here*    Discrimination  between  two  given  lemonades  \vas  established  when  at 
least  67  percent  of  the  judgments  (indicating  the  different  lemonade)  vfere 
correct «    There  are,  of  coiirse,  individual  differences  in  taste  sensitivity* 
The  above  statistical  requirement  means  that  the  results  were  greatly  influenced 
by  the  extent  persons  with  below-average  taste  sensitivity  participated  in  the 
tests*    It  can  be  assumed  that  among  consumers  there  is  a  small  proportion,  but 
still  a  large  number,  of  people  who  can  detect  differences  much  less  in  magni- 
tude than  those  utilized  in  this  study.    The  reactions  of  this  group  to  relative- 
ly small  changes  in  the  product  could  have  serious  influence  on  product  acceptance 
For  example,  suppose  10  percent  of  consumers  could  detect  a  decrease  of  15  per- 
cent in  °Brix  and  9  percent  in  Brix-acid  ratio  and  that  they  disliked  the  result- 
ing product  to  the  extent  that  they  stopped  buying  it^    It  is  obvious  that  such 
behavior  on  the  part  of  10  percent  of  the  market  would  be  important  to  producers* 

This  raises  the  question  as  to  whether  research  on  taste  preferences 
should  not  be  based  upon  consumers  with  better-than-average  taste  discrimination 
ability.    If  the  answer  is  that  concern  should  be  v/ith  such  a  group  it  vrauld 
mean  that  special  tests  would  have  to  be  employed  to  locate  these  particular 
people  before  undertaking  the  preference  research.  | 

SUJiilARY 

1.  Within  the  commercially  feasible  range,  as  presently  defined,  most  people  are 
unable  to  detect  "^Brix  and  Brix-acid  ratio  differences  in  frozen  concentrates 
for  lemonade.  h 

I 

2.  In  the  set  of  21  frozen  concentrates  for  lemonade  used  in  this  research,  fouir 
were  mutually  discriminable :    No©  1  -  6o70  ^Brix,  11b2  Brix-acid  ratio;  No.  '. 
8  -  9^19  °Brix,  13.1  Brix-acid  ratio;  Noc  Ih  -  12„0&  °Brix,  lko9  Brix-acid  • 
ratio;  No.  21  -  1^.23  *^Brix,  19»0  Brix-acid  ratio o   With  the  exception  of 
lemonade  No*  Ihj  all  of  these  are  beyond  the  limits  of  the  commercially 
feasible  range* 

3*    In  ascertaining  preferences  for  the  four  discriminable  lemonades,  a  rank 

order  procedure  was  found  to  be  more  efficient  than  the  rating-scale  method* j 


II 
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he    Preliminary  preference  tests  showed  that  lemonade  No^.  lU  was  most  preferred, 
folloT/ed  by  lemonades  Wos.  21,  8.  and  1,  in  that  order* 

5«    Relative  homogeneity  of  opinion  was  associated  with  negative  attitudes  toward 
the  lemonades  of  low  °Brix  and  loxs  Brix-acid  ratio  a 

i6.    It  is  recommended  that  four  frozen  concentrates  for  lemonade  somewhat  beyond 
the  range  of  commercial  feasibility  be  used  in  large-scale,  regional  pref- 
erence research  so  that  consumer  reactions  to  changes  in  the  product  in  given 
directions  can  be  anticipated. 
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